Brownian motion and diffusion: from stochastic processes to chaos and beyond 
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One century after Einstein's work, Brownian Motion still remains both a fundamental open issue 
and a continous source of inspiration for many areas of natural sciences. We first present a discussion 
about stochastic and deterministic approaches proposed in the literature to model the Brownian 
Motion and more general diffusive behaviours. Then, we focus on the problems concerning the 
determination of the microscopic nature of diffusion by means of data analysis. Finally, we discuss 
the general conditions required for the onset of large scale diffusive motion. 
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Brownian motion (BM) played a fundamental 
role in the development of molecular theory of 
matter, statistical mechanics and stochastic pro- 
cesses. Remarkably, one century after Einstein's 
work, BM is still at the origin of scientific dis- 
cussions as testified by a recent experiment per- 
formed to detect a trace of deterministic chaotic 
sources on macroscopic diffusion. Several au- 
thors, which discussed the results of such an ex- 
periment, argued that the possibility to discern 
experimentally between a deterministic chaotic 
and noisy dynamics, at the microscopic level, is 
severely limited by subtle technical and concep- 
tual points. However, the remarks raised by the 
scientific community have gone over the criticism 
and have led to a deeper understanding of the 
role of chaos in the diffusion. 

After a short historical introduction to BM, 
we focus on the dynamical conditions to observe 
macroscopic diffusion. In particular, we discuss 
the technical and conceptual limits in distinguish- 
ing, by means of data analysis, the deterministic 
or stochastic nature of diffusion. A main tool for 
that is the e-entropy. Part of the discussion is de- 
voted to the problem of macroscopic diffusion in 
deterministic non-chaotic dynamics. 



I. INTRODUCTION 

At the beginning of the twentieth century, the atom- 
istic theory of matter was not yet fully accepted by 
the scientific community. While searching for phe- 
nomena that would prove, beyond any doubt, the ex- 
istence of atoms, Einstein realized that "... accord- 
ing to the molecular-kinetic theory of heat, bodies of 
microscopically-visible size suspended in a liquid will per- 
form movements of such magnitude that they can be eas- 
ily observed in a microscope as he wrote in his cele- 
brated paper in 1905—. In this work, devoted to explain 
the irregular motion of Browinan particles on theoretical 



grounds, Einstein argued that the motion of these small 
bodies has a diffusive character. Moreover, he discovered 
an important relation involving the diffusion coefficient 
D, the fluid viscosity n, the particles radius a (having as- 
sumed spherical particles), Avogadro's number Na, the 
temperature T and the gas constant R: 



D = 



1 RT 
Na 6nr/a 



(1) 



This relation can be employed, and actually had been, to 
determine experimentally the Avogadro's number—. In- 
deed, the diffusion coefficient can be measured by mon- 
itoring the growth, with time t, of the particle displace- 
ment Ax = x{t) — x(0), which is expected to behave as 



((Ax) 2 



2Dt 



(2) 



Einstein relation (JIJ , that may be seen as the first exam- 
ple of the fluctuation-dissipation theorem—, allowed for 
the determination of Avogadro's number and gave one of 
the ultimate evidences of the existence of atoms. 

Einstein's theoretical explanation of BM is based on 
the intuition that the irregular motion of a Brownian 
particle is a consequence of the huge number of collisions 
per unit time with the surrounding fluid molecules. Since 
Einstein's approach, diffusion and irregular phenomena 
were commonly associated to the presence of many de- 
grees of freedom. The effects of the disregarded degrees 
of freedom on an observed small part of a system can be 
either studied directly (as initiated by Smoluchowskii) or 
modeled by means of stochastic dynamics (as proposed 
by Langevin 5 ). From the latter point of view, BM pro- 
vided the first and main stimulus to the building of the 
modern theory of stochastic processes. 

After the (re)discovery of deterministic chaos&£, it was 
clear that also fully deterministic and low dimensional 
systems can give rise to erratic seemingly random mo- 
tions, practically indistinguishable from those produced 
by a stochastic process. This implied an affective unpre- 
dictability of chaotic systems and the need for a proba- 
bilistic description also of a strictly deterministic world. 
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The success in understanding the basic mechanisms for 
the onset of chaos, and the wealth of interesting phenom- 
ena occurring in low dimensional systems hinted at opti- 
mistic expectations about the possibility of a systematic 
deterministic approach to irregular natural phenomena. 
This rised a rapid development of time series analysis 
with the idea to demonstrate the deterministic character 
of many irregular phenomena. 

Nowadays we are aware of the limits of this optimistic 
programme^, and we know that a definite answer on 
the deterministic or stochastic character of experimental 
signals is impossible. However, some tools of time series 
analysis, such as the entropy analysis at varying the scale 
of resolution, are very useful to characterize important 
features of complex systems. Among the recent develop- 
ments in this context, we can mention the experiment by 
Gaspard et al^ on the motion of a Brownian particle. 
The debat o 11 ! 12 around the possible theoretical interpre- 
tation of the experiment is a clear indication of how, one 
century after the seminal Einstein's work, BM continues 
to be a subject of intricate and fascinating discussions. 

Beyond its undoubted importance for applications in 
many natural phenomena, deterministic chaos also en- 
forces us to reconsider some basic problems standing at 
the foundations of statistical mechanics such as, for in- 
stance, the applicability of a statistical description to low 
dimensional systems. 

In addition, the combined effects of noise and deter- 
ministic evolution can generate highly nontrivial and 
rather intriguing behaviours. As an example, we just 
mention the stochastic resonanc o 13,14 and the role of col- 
ored noise in dynamical systems^ 5 - 

The aim of this paper is a discussion on the viable ap- 
proaches to characterize and understand the dynamical 
(microscopic) character of BM (Sect. II). In particular, 
we shall focus on the distinction between chaos and noise 
from a data analysis and on conceptual aspects of the 
modeling problem (Sect. III). Moreover, we shall investi- 
gate and discuss about the basic microscopic ingredients 
necessary for BM as, for instance, the possibility of gen- 
uine BM in non-chaotic deterministic systems (Sect. IV). 
Finally, we conclude (Sect. V) with a discussion on the 
role of chaos in statistical mechanics. 



II. THE ORIGIN OF DIFFUSION 

Einstein's work on BM is based on statistical mechan- 
ics and thermodynamical considerations applied to sus- 
pended particles, with the assumption of velocity decor- 
relation (molecular chaos). 

Instead, one of the first attempts to develop a purely 
dynamical theory of BM dates back to Langevin 5 . that, as 
himself writes, gave "... a demonstration [of Einstein re- 
sults] that is infinitely more simple by means of a method 
that is entirely different." Langevin considers the Newton 
equation for a small spherical particle in a fluid, taking 
into account that the Stokes viscous force it experiences 



is only a mean force. In one direction, say e.g. the re- 
direction, one has: 



m 



dt 2 



a dx 
-oirria — - 

1 dt 



F 



(3) 



where m is the mass of the particle. In the r.h.s. the first 
term is the Stokes viscous force. F is a fluctuating ran- 
dom force which models the effects of the huge number of 
impacts with the surrounding fluid molecules, responsi- 
ble for the thermal agitation of the particle. In statistical 
mechanics terms, this corresponds to molecular chaos. 

With the assumption that the force F is a Gaussian, 
time uncorrelated random variable, the probability dis- 
tribution functions (pdf) for the position and velocity of 
the Brownian particle can be exactly derived^. In par- 
ticular, the pdf of the position, at long times, reduces to 
the Gaussian distribution in agreement with Einstein's 
result. 

Langevin's work along with that of Ornstein and Uh- 
lenbecki^ are at the foundation of the theory of stochastic 
differential equations. The stochastic approach is how- 
ever unsatisfactory being at the level of a phenomenolog- 
ical description. 

The next theoretical challenge toward the building of 
a dynamical theory of Brownian motion is to understand 
its microscopic origin from first principles. A very early 
attempt was made in 1906 by Smoluchowski, who tried 
to derive the large scale diffusion of Brownian particles 
starting from the microscopic description of their colli- 
sions with the fluid molecules 4 ". A renewed interest on 
the subject appeared some years later, when it was re- 
alized that even purely deterministic systems composed 
of a large number of particles produce macroscopic dif- 
fusion, at least on finite time scales. These models had 
an important impact in the justification of Brownian mo- 
tion theory and, more in general, in deriving a consistent 
microscopic theory of irreversibility. 

Some of these works considered chains of harmonic 
oscillators of equal massesii 1 ^* 1 ^* 2 ^, while otheisM^iSl 
analyzed the motion of a heavy impurity linearly cou- 
pled to a chain of equal mass oscillators. For an infinite 
number of oscillators, the momentum of the heavy parti- 
cle behaves as a genuine stochastic process described by 
the Langevin equation yj. When their number is finite, 
diffusion remains an effective phenomenon lasting for a 
(long but) limited time. 

Soon after the discovery of dynamical chaos, it was 
realized that also simple low dimensional deterministic 
systems may exhibit a diffusive behavior. In this frame- 
work, the two-dimensional Lorentz gas^a, describing the 
motion of a free particle through a lattice of hard round 
obstacles, provided the most valuable example. Particle 
trajectories can be ballistic (with very few collisions in 
the case of infinite horizon) or chaotic as a consequence of 
the convexity of the obstacles. In the latter case, at large 
times, the mean square displacement from the particle 
initial condition grows linearly with time. Lorentz sys- 
tem is closely related to the Sinai billiard 25,26 , which can 
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be obtained from the Lorentz gas by folding the trajecto- 
ries into the unitary lattice cell. The extensive study on 
billiards has shown that chaotic behavior might usually 
be associated to diffusion in simple low dimensional mod- 
els, supporting the idea that chaos was at the very origin 
of diffusion. However, more recently (see e.g. Ref. 1271) it 
has been shown that even non-chaotic deterministic sys- 
tems, such as a bouncing particle in a two-dimensional 
billiard with polygonal but randomly distributed obsta- 
cles (wind-tree Ehrenfest model) , may exhibit a diffusion- 
like behavior (see Sect. IV). 

Deterministic diffusion is a generic phenomenon 
present also in simple chaotic maps on the line. Among 
the many contributions we mention the work by Fujisaka, 
Grossmann 2 &22i and Geisel2fli2i. A typical example is the 
Id discrete-time dynamical system: 

x(t + l) = [x(t)]+F(x(t)-[x(t)}), (4) 

where x(t) (the position of a point-like particle) performs 
diffusion in the real axis. The bracket [. . . ] denotes the 
integer part of the argument. F(u) is a map defined on 
the interval [0, 1] that fulfills the following properties: 

i) The map, u(t + 1) = F(u(t)) (mod 1) is chaotic. 

ii) F(u) must be larger than I and smaller than for 
some values of u, so there exists a non vanishing prob- 
ability to escape from each unit cell (a unit cell of real 
axis is every interval Ci = [£, £ + 1], with I £ Z). 

iii) F r (u) = 1 — Fi(l — u), where Fi and F r define the 
map in u £ [0, l/2[ and u £ [1/2,1] respectively. This 
anti-symmetry condition with respect to u = 1/2 is in- 
troduced to avoid a net drift. 

A very simple and much studied example of F is 

(A _( 2(1 + a)u if«e[0,l/2[ f l 

* [U) ~ \2{l + a){u-l) + l if ue [1/2,1] W 

where a > is the control parameter. It is useful to 
remind the link between diffusion and velocity correla- 
tion, i.e. the Taylor-Kubo formula, that helps in under- 
standing how diffusion can be realized in different ways. 
Defining C(r) = (v(t)v(O)) as the velocity correlation 
function, where v(t) is the velocity of the particle at time 
t. It is easy to see that for continuous time systems (e.g. 
Eq.@) 

((x(t) - z(0)) 2 ) ~ 2 t f dr C(t) . (6) 
Jo 

Standard diffusion, with D = dr C(r), is always 
obtained whenever the hypotheses for the validity of the 
central limit theorem are verified: 

I) the variance of the velocity must be finite: (v 2 ) < oo 

II) the decay to zero of the velocity correlation function 
C(t) at large times should be faster than r _1 . 

In discrete-time systems, the velocity v(t) and the in- 
tegration of C(t) are replaced by the finite difference 
x(t + 1) - x(t) and by the quantity (u(0) 2 ) /2 + J2 T C ( T ) 
respectively. 



Condition I) is justified by the fact that having an 
infinite variance for the velocity is rather unphysical. 
It should be noted that this requirement is indepen- 
dent of the microscopic dynamics under consideration: 
Langevin, deterministic chaotic or regular dynamics. 

Condition II), corresponding to the request of molec- 
ular chaos, is surely verified for the Langevin dynam- 
ics where the presence of the stochastic force entails a 
rapid decay of C(r). In deterministic regular systems, 
such as the many oscillator model, the velocity decorre- 
lation comes from the huge number of degrees of freedom 
that act as a heat bath on a single oscillator. While in 
the (non-chaotic) Ehrenfest wind-tree model decorrela- 
tion originates from the disorder in the obstacle positions, 
the situation is more subtle for deterministic chaotic sys- 
tems. In fact, even if nonlinear instabilities generically 
lead to a memory loss and, henceforth, to the validity 
of the molecular-chaos hypothesis, slow decay of correla- 
tion , e.g. C(t) ~ with j3 < 1, may appear in very 
intermittent systems^. When this happens, condition 
II) is violated, and superdiffusion, (x 2 (t)) ~ i 2 "' 3 , is ob- 
served. Though interesting, superdiffusion is a quite rare 
phenomenon. Moreover, usually, small changes of the 
control parameters of the dynamics restore standard dif- 
fusion. Therefore, also for chaotic systems we can state 
that the "rule" is the standard diffusion and the "excep- 
tion" is the superdiffusion^. 

We end this section by asking whether is it possible to 
determine, by the analysis of a Brownian particle, if the 
microscopic dynamics underlying the observed macro- 
scopic diffusion is stochastic, deterministic chaotic or reg- 
ular? 



III. DISTINCTION BETWEEN CHAOS AND 
NOISE 

Inferring the microscopic deterministic character of 
Brownian motion on an experimental basis would be 
attractive from a fundamental viewpoint. Moreover it 
could provide further evidence to some recent theoreti- 
cal and numerical studies^iS. Before discussing a recent 
experiment's in this direction, we must open the "Pan- 
dora box" of the longstanding and controversial problem 
of distinguishing chaos from noise in signal analysis^. 

The first observation is that, very often in the analysis 
of experimental time series, there is not a unique model of 
the "system" that produced the data. Moreover, even the 
knowledge of the "true" model might not be an adequate 
answer about the character of the signal. From this point 
of view, BM is a paradigmatic example: in fact it can be 
modeled by a stochastic as well as by a deterministic 
chaotic or regular process. 

In principle a definite answer exist. If we were able to 
determine the maximum Lyapunov exponent (A) or the 
Kolmogorov-Sinai entropy (has) °f a data sequence, we 
would know without uncertainty whether the sequence 
was generated by a deterministic law (A, hxs < oo) or 
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by a stochastic one (\,tiKS — ► oo). Nevertheless, there 
are unavoidable practical limitations in computing such 
quantities. Those are indeed defined as infinite time av- 
erages taken in the limit of arbitrary fine resolution. But, 
in experiments, we have access only to a finite, and often 
very limited, range of scales and times. 

However, there are measurable quantities that are ap- 
propriate for extracting information on the signal charac- 
ter. In particular, we shall consider the (e, r)-entropy per 
unit tim o 37 ! 38 ! 39 h(e,r) that generalizes the Kolmogorov- 
Sinai entropy. In a nutshell, while for evaluating hxs 
one has to detect the properties of a system with infinite 
resolution, for /i(e, r) a finite scale (resolution) e is re- 
quested. The Kolmogorov-Sinai entropy is recovered in 
the limit e — > 0, i.e. h(e, r) — > hxs- This means that 
if we had access to arbitrarily small scales, we could an- 
swer the original question about the character of the law 
that generated the recorded signal. Even if this limit is 
unattainable, still the behavior of h(e,r) provides a very 
useful scale-dependent description of the nature of a sig- 
nal. 



A. e-entropy 

The e-entropy was originally introduced in the con- 
text of information theory by Shannon 3 ^ and, later, by 
Kolmogoro\i 3 i in the theory of stochastic processes. An 
operative definition is as follows. 

One considers a continuous variable x(i) € 3fJ d , that 
represents the state of a d-dimensional system, and one 
introduces the vector 

X("')(t) = ( xWi ... iX ( t + mr-r)) , (7) 

which lives in $t md and is a portion of the trajectory 
discretized in time with step r. Then the phase space 
5R d is partitioned using hyper-cubic cells of side e. The 
vector X^" 1 ) (t) is coded into the word, of length m, 

W m (e, t) = (*(e, t),..., i(e, t + mr - r)) , (8) 

where i(e, t+jr) labels the cell in containing x(t+jr). 
For bounded motions, the number of visited cells (i.e. 
the alphabet) is finite. Under the hypothesis of sta- 
tionarity, the probabilities P(W m (e)) of the admissible 
words {W^ m (e)} are obtained from the time evolution of 
X( m )(t). The (e, r)-entropy per unit time, h(e,r) is then 
defined byS 8 .: 

h(e,r)= lim h m (e,r) = - lim —H m (e,r), (9) 

m— »oc 7" m — >oo 777 

where H m is the m-block entropy: 

H m (e,r) = - P(W m (e))\nP(W m (e)), (10) 

(W™(e)} 

and h m {e,r) = [H m+1 (e,r) - H m {e,T)]/r. 

It is worth remarking a few important points. A rig- 
orous mathematical procedure 3 ^ would require to take 



the infimum over all possible partitions with elements of 
size smaller than e. The Kolmogorov-Sinai entropy is 
obtained in the limit of small e 

h KS = lim h(e,r) . (11) 

e— »0 

Note that in deterministic systems h(e) and henceforth 
hfes do not depend on the sampling time so that 111|) 
can be in principle used with any choice of r— . However, 
in practical computations, where the rigorous definition 
is not applicable, the specific value of r is important 
and h(e) may also depend on the used norm. For very 
small e, no matter of the norm, the correct value of the 
Kolmogorov-Sinai entropy is usually recovered. Indeed, 
when the partition is very fine, usually, it well approxi- 
mates a generating partition. It is worth reminding that 
the Kolmogorov-Sinai entropy is a dynamical invariant, 
i.e. independent of the used state representation JJJ. 

In deterministic systems the following chain of inequal- 
ities holds^S 

+ 

h(e,T)<h KS <J2 X ^ ( 12 ) 

i 

where the summation is over all positive Lyapunov expo- 
nents. A system is chaotic when < Hks < oo and reg- 
ular when Hks — 0- Typically, one observes that h(e,r) 
attains a plateau hxSi below a resolution threshold, e c , 
associated to the smallest characteristic length scale of 
the system. Instead, for e > e c due to iff^l h(e, t) < hxsi 
in this range the details of the e-dependence may be infor- 
mative on the large scale (slow) dynamics of the system 
(see e.g. Refs. l36l4l|) . 

In stochastic signals hxs = °o, but for any e > 0, 
/i(e, r) is finite and a well defined function of e and r. The 
nature of the dependence of h(e, t) on e and t provide 
a characterization of the underlying stochastic process 
(see Refs. I3I3I4I . For an important and wide class 
of stochastic processes^ 9 - an explicit expression for h(e, r) 
can be given in the limit r — > 0. This is the case of 
stationary Gaussian processes characterized by a power 
spectrum S(u>) oc uj~ t - 2a+1 \ with < a < 1, for which 37 : 

lim^(e,T)-e- 1 / Q . (13) 

T — >0 

The case a — 1/2, corresponding to the power spec- 
trum of a Brownian signal, would give h(e) ~ (T 2 . Some 
stochastic processes, such as e.g. time uncorrelated and 
bounded ones, are characterized by a logarithmic diver- 
gence below a critical e c , which may depend on r. 

B. Numerical determination of the e-entropy 

In experiments, usually, only a scalar variable 
u(t) can be measured and moreover the dimen- 
sionality of the phase space is not known. In 
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FIG. 1: Numerically evaluated (e, r)-entropy for the map 11411 
with p — 0.8 computed by the standard techniques [6] at r = 1 
(o), t = 10 (A) and r = 100 ( v) and different block length 
(m = 4, 8, 12, 20). The boxes give the entropy computed with 
r = 1 by using periodic boundary condition over 40 cells. The 
straight lines correspond to the two asymptotic behaviors, 
h(e) = has — 1-15 and h(e) ~ e -2 . 



these cases it is reconstructed by delay embedding 
technique^, where the vector "XS m >(t) is build as 
(u(t), u(t + t), . . . , u(t + mT — t)), now in 3? m . This is 
a special instance of Q. 

Then to determine the entropies H m (e), very efficient 
numerical methods are available 42 '— (the reader may find 
an exhaustive review in Refs.|8||9|). Here, avoiding techni- 
calities, we just mention some subtle points which should 
be taken into account in data analysis. 

First, if the information dimension of the attractor for 
a given system is d± then, to have a meaningful measure 
of the entropy, the embedding dimension m has to be 
larger than d\. Second, as above mentioned, the plateau 
^m(e) ~ has appears only below a critical e c , meaning 
that it is possible to distinguish a deterministic signal 
from a random one only for e < e c . However, one should 
be aware of the fact that the finiteness of the data set 
imposes a lower cut-off scale td below which no informa- 
tion can be extracted from the data (see Ref. |44|) . Also 
in stochastic signals, there exists a lower critical cut-off 
ed due to the finiteness of the data set, and often, as 
mentioned at the end of the previous subsection, one has 
logarithmic divergences below e c . Since, this is also what 
happens in general for e < e^, the interpretation of the 
results requires much attention^S^i. 

Therefore, if m is not large enough and/or e is not 
small enough (or in the lack of a good estimation of the 
important range of scales for the different behaviors) one 
may obtain misleading results. 

Another important problem concerns the choice of r. 
If r is much larger or much shorter than the characteristic 
time-scale of the system at the scale e, then the correct 
behavior of the e-entropy^ cannot be properly recovered. 

To exemplify the above difficulties let us consider the 



map 

x(t+l) = x(t)+psin(2nx(t)), (14) 

which, for p > 0.7326..., is chaotic (similarly to (@J) 
and displays large scale diffusion. On the basis of the 
previous discussion, the e-entropy is expected to behave 
as 

{A for e < 1 
(15) 
D/e 2 for e > 1 

where A is the Lyapunov exponent and D is the diffu- 
sion coefficient. The typical problems encountered in nu- 
merically computing h(e) can be appreciated in Fig. ^ 
First notice that the threshold e c « 1. As for the impor- 
tance of the choice of r, note that the diffusive behavior 
h(e) ~ e -2 is roughly obtained only by considering the 
envelope of /i m (e,r) evaluated at different values of r. 
The reason for this is as follows. The natural sampling 
interval would be r = 1, however this choice requires 
considering larger and larger embedding dimensions m 
at increasing e. Indeed, a simple dimensional argument 
suggests that the characteristic time of the system is de- 
termined by its diffusive behaviour T e ss e 2 / D. If we con- 
sider for example, e = 10 and the typical values of the 
diffusion coefficient D ~ 10 _1 , the characteristic time, 
T c , is much larger than the elementary sampling time 
t = 1. On the other hand, the plateau at the value Kks 
can be recovered only for r w 1, even if, in principle, any 
value of t could be used. 

The above difficulties can be partially overcome by 
means of a recently introduced method based on exit 
timeA The main advantage of this approach is that it 
is not needed to fix a priori r, because the "correct" r is 
automatically selected. 

C. Does Brownian motion arise from chaos, noise 
or regular dynamics? 

We are now ready to discuss the experiment and its 
results reported in Ref. 10. In this experiment, a long 
time record (about 1.5 x 10 5 data points) of the mo- 
tion of a small colloidal particle in water was sampled 
at regular time intervals (At — 1/60 s) with a remark- 
able high spatial resolution (25 nm). To our knowledge, 
this is the most accurate measurement of a BM. The 
data were then processed by means of standard nonlin- 
ear time-series analysis tools, i.e. the Cohen-Procaccia 
method 42 , to compute the e-entropy. This computation 
shows a power- law dependence h(e) ~ e _ ~. Actually, 
similarly to what displayed in Fig. ^ this behavior is 
recovered only by considering the envelope of the h(e, r)- 
curves, for different r's. However, unlike to Fig.^ n o sat- 
uration h(e,T) w const is observed in the small e-region 
because of the finiteness of data set and resolution as well. 
From the previous discussion, this can be understood as 
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FIG. 2: (a) Signals obtained from Eq. JT7J with A/ = 10 4 and 
random phases uniformly distributed in [0, 27r]. The numer- 
ically computed diffusion constant is D w 0.007. (b) Time 
record obtained with a continuous random walk 1161 with the 
same value of the diffusion constant as in (a). In both cases 
data are sampled with r = 0.02, i.e. 10 5 data points. 



the fact that e c of the observed system is much smaller 
than the smallest detectable scale extracted from data 
and therefore the -ftTS'-entropy cannot be properly esti- 
mated. Nevertheless, from the chain of inequalities l|12|) 
and by assuming from the outset that the system dynam- 
ics is deterministic, the authors deduce, from the positiv- 
ity of h(e), the existence of positive Lyapunov exponents 
in the system. Their conclusion is thus that microscopic 
chaos is at the origin of the macroscopic diffusive behav- 
ior. 

As pointed out by several works, a few points need to 
be considered in the data analysis of the aforementioned 
experiment, namely: the huge amount of involved degrees 
of freedom (Brownian particle and the fluid molecules); 
the impossibility to reach high enough (spatial and tem- 
poral) resolution; the limited amount of data points. 

The limitation induced by the finite resolution is par- 
ticularly relevant to the experiment. Even if one assumes 
that the number of data points and the embedding di- 
mension are large enough, the impossibility to see a sat- 
uration to a constant value, h(e) ~ const, prevents any 
conclusion about the character of the analyzed signal. 
For example, whenever the the analysis of Fig. would 
be restricted to the region with e > 1, then discerning 
whether the data were originated by a chaotic system or 
by a stochastic process would be impossible. In fact in 
both cases the behavior h(e) ~ e -2 would have been ob- 
served. 

As for the number of degrees of freedom, we recall that, 
for a correct evaluation of the entropy of the microscopic 
dynamics, a very high embedding dimension should be 
used, in practice m > d\. For a fluid (with O(10 23 ) 
molecules) the necessary number of points is of course 
prohibitive. Moreover, as stressed by Grassberger and 
Schreiber— , when the number of degrees of freedom is so 
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FIG. 3: h(e) computed with the Grassberger-Procaccia algo- 
rithm using using 10 points from the time series of Fig. |5] 
We show the results for embedding dimension m — 50. The 
straight-lines show the D/e 2 behavior. 



high that it can be considered practically infinite there 
is an additional difficulty related to the definition of en- 
tropy and Lyapunov exponents, which become norm de- 
pendent. 

Furthermore, the limited amount of data severely af- 
fects even our ability to recognize if the signal is deter- 
ministic but of zero entropy (i.e. regular). This has been 
pointed out by Dettmann et al^i*2£, who have shown 
that the same entropic analysis of Ref. 0, applied to the 
Ehrcnfcst wind-tree model (see next section) reproduced 
results very similar to those extracted in the Brownian 
experiment. This model is deterministic and non-chaotic. 
In fact if the time records were long enough to see the pe- 
riodic nature of the signal, and the embedding dimension 
high enough to resolve the system manifold, the mea- 
sured entropy would have been zero. 

The following example serves as a clue to better un- 
derstand these points. Let us consider two signals, the 
first generated by a continuous random walk: 



x(t) 



(16) 



where r\ is a 

MtMf )) = s(t 



zero mean Gaussian variable with 
- t'), and the second obtained as a su- 
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perpositions of Fourier modes: 

M 

x(t) = Xoi sin (Hit + (f>i) . (17) 

i=l 

The coordinate x(t) in Eq. (|17fl . upon properly choosing 
the frequencie o 23 i 36 and the amplitudes (e.g. X oi oc 07" ), 
describes the motion of a heavy impurity in a chain of M 
linearly coupled harmonic oscillators. We knowS 3 . that 
x(t) performs a genuine BM in the limit M — > oo. For 
M < oo the motion is periodic and regular, nevertheless 
for large but finite times it is impossible to distinguish 
signals obtained by Ijlfip and 117JI (see Fig. [3J . This is 
even more striking looking at the computed e-entropy of 
both signals (see Fig.[3J). 

The results of Fig. [3] along with those by Dettman 
et al^i suggest that, also by assuming the deterministic 
character of the system, we are in the practical impossi- 
bility of discerning chaotic from regular motion. 

From the above discussion, one may have reached a 
very pessimistic view on the possibility to detect the 
"true" nature of a signal by means of data analysis 
only. However the scenario is different when the ques- 
tion about the character of a signal remains restricted 
only to a certain interval of scales. In this case, in fact, 
it is possible to give an unambiguous classification of 
the signal character based solely on the entropy analysis 
and free from any prior knowledge on the system/model 
that generated the data. Indeed, we can define stochas- 
tic/deterministic behavior of a time series on the basis of 
the absence/presence of a saturation plateau h(e) ~ const 
in the observed range of scales. Moreover the behaviour 
of /i(e, r) as a function of (e, r) provides a very useful "dy- 
namical" classification of stochastic processes 39-45 . One 
has then a practical tool to classify the character of a 
signal as deterministic or stochastic without referring 
to a specific model, and is no longer obliged to answer 
the metaphysical question, whether the system that pro- 
duced the data was a deterministic or a stochastio 3 ^ 4 ^ 
one. 

This is not a mere way to escape the original question. 
Indeed, it is now clear that the maximum Lyapunov ex- 
ponent and the Kolmogorov-Sinai entropy are not com- 
pletely satisfactory for a proper characterization of the 
many faces of complexity and predictability of nontrivial 
systems, such as intermittent systems or with many de- 
grees of freedom (e.g., turbulence)^. 

In the literature the reader may find several meth- 
ods developed to distinguish chaos from noise. They are 
based on the difference in the predictability using predic- 
tion algorithms rather than estimating the entropy 4 ^^ 
or they relate determinism to the smoothness of the sig- 
na j49 i 50_ ah these methods have in common the neces- 
sity to choose a certain length scale e and a particular 
embedding dimension m, therefore they suffer the same 
limitations of the entropy analysis presented here. 



IV. DIFFUSION IN NON-CHAOTIC SYSTEMS 

With all the provisos concerning its interpretation, 
Gaspard's and coworkers— experiment had a very pos- 
itive role not only in stimulating the discussion about 
the chaos/noise distinction but also in focusing the at- 
tention on deep conceptual aspects of diffusion. In this 
context, from a theoretical point of view, the study of 
chaotic models exhibiting diffusion and their non-chaotic 
counterpart contributed to a better understanding of the 
role of chaos on macroscopic diffusion. 

In Lorentz gases, the diffusion coefficient is related, 
by means of periodic orbits expansion methods 5 ^^^, 
to chaotic indicators such as the Lyapunov exponents. 
This suggested, for certain time, that chaos was or might 
have been the basic ingredient for diffusion. However, 
as argued by Dettmann and Cohen^i, even an accurate 
numerical analysis based on the e-entropy has no chance 
to detect differences in the diffusive behavior between 
a chaotic Lorentz gas and its non-chaotic counterpart, 
such as the wind-tree Ehrenfest's model. In the latter 
model, particles (wind) scatter against square obstacles 
(trees) randomly distributed in the plane but with fixed 
orientation. Since the reflection by the flat edges of the 
obstacles cannot produce exponential separation of tra- 
jectories, the maximal Lyapunov exponent is zero and the 
system is not chaotic. In this case the relation between 
the diffusion coefficient and the Lyapunov exponents is 
of course nullified. 

The result of Ref. [27] implies thus that chaos may 
be not indispensable for having deterministic diffusion. 
The question may be now posed on what are the nec- 
essary microscopic ingredients to observe deterministic 
diffusion at large scales. In the wind-tree Ehrenfest's 
model, most likely, the disorder in the distribution of 
the obstacles is crucial. In particular, one may conjec- 
ture that a finite spatial entropy density, /is, is neces- 
sary to the diffusion. So that deterministic diffusion may 
be a consequence either of a non-zero "dynamical" en- 
tropy (hpes > 0) in chaotic systems or of a non-zero 
"static" entropy (hs > 0) for non-chaotic systems. This 
is key-point, because someone can argue that a deter- 
ministic infinite system with spatial randomness can be 
interpreted as an effective stochastic system, but this is 
probably a "matter of taste". With the aim of clari- 
fying this point, we consider now a spatially disordered 
non-chaotic models, which is the one-dimensional ana- 
log of a two-dimensional non-chaotic Lorentz system with 
polygonal obstacles. It has the advantage that both 
the case with finite and zero spatial entropy density can 
be investigated. Let us start with the map defined by 
Eqs. (@J and JSJ, and introduce some modifications to 
make it non-chaotic. One can proceed as exemplified 
by Fig. 0] that is by replacing the function © on each 
unit cell by its step-wise approximation that is gener- 
ated as follows. The first-half of Ci is partitioned in TV 
micro-intervals [i + £ n -i,£ + £ n [ , n = 1,...,N, with 
£o = < £i <&<••• < < £ w = 1/2. In each 
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show that D is significantly different from zero only for 
values e > e c . For e > e c , D exhibits a saturation close 
to the value of the chaotic system (horizontal line) de- 
fined by Eqs. an( i ©■ The existence of a threshold 
e c is not surprising. Due to the staircase nature of the 
system, the perturbation has to exceed the typical dis- 
continuity of Fa to activate the "macroscopic" instability 
which is the first step toward the diffusion. Data collaps- 
ing, obtained by plotting D versus sN, in Fig. [3] confirms 
this argument. These findings are robust and do not de- 
pend on the details of forcing. Therefore, we have an 
example of a non-chaotic model in the Lyapunov sense 
by construction, which performs diffusion. Now the ques- 



FIG. 4: Sketch of the random staircase map in the unitary 
cell. The parameter a defining the macroscopic slope is set 
to 0.23. Half domain [0, 1/2] is divided into N = 12 micro- 
intervals of random size. The map on [1/2, 1] is obtained by 
applying the antisymmetric transformation with respect to 
the center of the cell (1/2, 1/2). 



interval the map is defined by its linear approximation 

F A (u) = u-£ n + F(f„) if u e [£„-!,£„[ , (18) 

where F(£ n ) is (JSJ evaluated at £„. The map in the sec- 
ond half of the unit cell is then determined by the anti- 
symmetry condition with respect to the middle of the 
cell. The quenched random variables {£,k}k=i are uru ~ 
formly distributed in the interval [0, 1/2], i.e. the micro- 
intervals have a random extension. Further they are cho- 
sen independently in each cell Ci (so one should properly 

write tin" 1 )- All cells are partitioned into the same num- 
ber N of randomly chosen micro-intervals (of mean size 
A = l/N). The modification of the continuous chaotic 
system is conceptually equivalent to replacing circular by 
polygonal obstacles in the Lorentz system^. The steps 
with unitary slope are indeed the analogous of the flat 
boundaries of the polygon. While the discontinuities in 
Fa, allowing for a moderate dispersion of trajectories, 
play a role similar to the vertex of the polygon that splits 
a narrow beam of particles hitting on it. Since Fa has 
slope 1 almost everywhere, the map is no longer chaotic, 
violating the condition i) (see Sect.[H]). For A — > (i.e. 
N — ► oo) the continuous chaotic map (J3} is recovered. 
However, this limit is singular and as soon as the num- 
ber of intervals is finite, even if extremely large, chaos is 
absent, ft has been foundM that this model still exhibits 
diffusion in the presence of both quenched disorder and 
a quasi-periodic external perturbation 

x(t + l) = [x(t)] +F A {x(t) - [x(t)]) +scos(at) . (19) 

The strength of the external forcing is controlled by e 
and a defines its frequency, while A indicates a specific 
quenched disorder realization. 

The diffusion coefficient D has been numerically com- 
puted from the linear asymptotic behavior of the mean 
square displacement. The results, summarized in Fig. \5\ 
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FIG. 5: Log-Log plot of the dependence of the diffusion co- 
efficient D on the external forcing strength e. Different data 
relative to a number of cell micro-intervals N = 50, 100 and 
150 are plotted vs the natural scaling variable eN to obtain 
a collapse of the curves. Horizontal line represents the result 
for chaotic system (I4I5B . 

tion concerns the possibility that the diffusive behavior 
arises from the presence of a quenched randomness with 
non zero spatial entropy per unit length. To clarify this 
point, similarly to Ref . 1271 the model can be modified in 
such a way that the spatial entropy per unit cell is forced 
to be zero, and see if the diffusion still persists. 

This programme can be accomplished by repeating the 
same disorder configuration every M cells (i.e. ^ = 

£,n +M ^), ensuring a zero entropy for unit length. Look- 
ing at the diffusion of an ensemble of walkers it was ob- 
served that diffusion is still present with D very close to 
the expected value (as in Fig. EJ- However, a close anal- 
ysis reveals the presence of weak average drift V, that 
vanishes approximately as V ~ 1/M for large M. This 
suggests that, at large times, ((x(t)) 2 ) ~ (Vt) 2 + 2Dt and 
the ballistic motion should overcome diffusion. However, 
the crossover time r c , at which the motion switches from 
diffusive to ballistic, diverges with M as r c ~ DM 2 , so 
for very large but finite M, the ballistic regime is not 
observed in simulations. Finally, it should be considered 
that the value of V depends on the realization of the ran- 
domness, and after averaging over the disorder the drift 



9 



becomes zero. Indeed the behavior V ~ 1/M indicates 
a self-averaging property for large M. Therefore, we can 
conclude that the system displays genuine diffusion for a 
very long times even with a vanishing (spatial) entropy 
density, at least for sufficiently large M. 

These results along with those by Dettmann and Co- 
hen^i allows us to draw some conclusions on the funda- 
mental ingredients for observing deterministic diffusion 
(both in chaotic and non-chaotic systems). 

• An instability mechanism is necessary to ensure 
particle dispersion at small scales (here small means 
inside the cells). In chaotic systems this is real- 
ized by the sensitivity to the initial condition. In 
non-chaotic systems this may be induced by a fi- 
nite size instability mechanisms. Also with zero 
maximal Lyapunov exponent one can have a fast 
increasing of the distance between two trajectories 
initially closed. In the wind-tree Ehrenfest model 
this stems from the edges of the obstacles, in "step- 
wise" system (|5I18I19|I from the jumps. 

• A mechanisms able to suppress periodic orbits and 
therefore to allow for a diffusion at large scale. 

It is clear that the first requirement is not very strong 
while the the second is more subtle. In systems with 
"strong chaos" , all periodic orbits are unstable and, so, it 
is automatically fulfilled. In non-chaotic systems, such as 
the non-chaotic billiards studied by Dettmann and Cohen 
and the map H5II8I19|I . the stable periodic orbits seem 
to be suppressed or, at least, strongly depressed, by the 
quenched randomness (also in the limit of zero spatial 
entropy). We note, that, unlike the two dimensional non- 
chaotic billiards, in the 1-d system (|5I18I19|) . the periodic 
orbits may survive to the presence of disorder, so we need 
the aid of a quasiperiodic perturbation to obtain their 
destruction and the consequent diffusion. 



V. DISCUSSIONS AND CONCLUSIONS 

Before summarizing the results of this article, we be- 
lieve that is conceptually important to comment about 
the relevance of chaos in statistical mechanics ap- 
proaches. 

The statistical mechanics^ 6 - had been funded by 
Maxwell, Boltzmann and Gibbs for systems with a very 
large number of degrees of freedom without any precise 
requirement on the microscopic dynamics, apart from the 
assumption of ergodicity. After the discovery of deter- 
ministic chaos it becomes clear that also in systems with 
few degrees of freedom statistical approaches are neces- 
sary. But, even after many years, the experts do not 
agree yet on the fundamental ingredients which should 
ensure the validity of the statistical mechanics. 

The spectrum of points of view is very wide, rang- 
ing from the Landau (and KhinchmS) belief on the 



main role of the many degrees of freedom and the (al- 
most) complete irrelevance of ergodicity, to the opin- 
ion of who, as Prigogine and his school^S*^, considers 
chaos as the basic ingredient. We strongly recommend 
the reading of Ref. |60| for a detailed discussion of irre- 
versibility. This work discusses the "orthodox" point of 
view (based on the role of the large number of degrees 
of freedom, as stressed by Boltzmann 61 ) re-proposed by 
Lebowita 6 ^ and the following debate on the role of de- 
terministic chaosS* 6 ^. Here we focus only on the aspects 
related to diffusion problems (and some related aspects, 
e.g. conduction). 

By means of the powerful method of periodic orbits 
expansion, in systems with very strong chaos (namely 
hyperbolic systems), it has been shown that there exists 
a close relation between transport properties (e.g. viscos- 
ity, thermal and electrical conductivity and diffusion co- 
efficients) and indicators of chaos (Lyapunov exponents, 
KS entropy, escape rate). These aspects are, e.g., dis- 
cussed in Rcfs. I5lll52[ At a first glance, the existence 
of such relations seem to give evidence against the "anti 
dynamical" point of view of Landau and Khinchin. How- 
ever, it may be incorrect to employ those results to obtain 
definite answers valid for generic systems. In fact it seems 
to us that there are rather clear evidences that chaos is 
not a necessary condition for the validity of some statis- 
tical behavios 6 ^i£i5iii&. Beyond the problem of diffusion in 
non-chaotic systems, it is worth mentioning the interest- 
ing results of Lepri et al*££ showing that the Gallavotti- 
Cohen formula^, originally proposed for chaotic systems, 
holds also in some non-chaotic model. Moreover, recently 
Li and coworkersSSii . studied the transport properties in 
quasi-one-dimensional channels with triangular scatters. 
In such systems, the maximal Lyapunov exponent is zero 
because of the flatness of triangle sides. However, nu- 
merical simulations show that, when the scatterers are 
placed at random (or their height is random) , the Fourier 
heat law remains valid. Another interesting non-chaotic 
model exhibiting the Fourier heat conduction is the sim- 
ple one-dimensional hard-particle system with alternat- 
ing masses^. For a recent review on heat conduction in 
one dimension see Ref F^) . 

These and many other examples prove that the heat 
conduction is present also in system without microscopic 
chaos. This is a further indication that microscopic chaos 
is not the unique possible source of a macroscopic trans- 
port in a given dynamical system. 

Finally let us briefly summarize the main items of this 
articles. The problem of distinguishing chaos from noise 
cannot receive an absolute answer in the framework of 
time series analysis. This is due to the finiteness of the 
observational data set and the impossibility to reach an 
arbitrary fine resolution and high embedding dimension. 
However, this restriction is not necessarily negative, and 
we can classify the signal behavior, without referring to 
any specific model, as stochastic or deterministic on a 
certain range of scales. 

Diffusion may be realized in stochastic and determin- 
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istic systems. In particular, in the latter case, chaos is 
not a prerequisite for observing diffusion and, more in 
general, nontrivial statistical behaviors. 
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